Package-level declarations

Read some input source and produce tokens.

Types

Link copied to clipboard
interface Scanner : Iterator<Token>

This interface represents an input stream of Tokens.

Link copied to clipboard
class ScannerImpl(settings: LoadSettings, reader: StreamReader) : Scanner

Scanner produces tokens of the following types:

Link copied to clipboard
class StreamReader(loadSettings: LoadSettings, stream: Source)

Reads the provided stream of code points, and implements look-ahead operations.